(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

Internationa] Bureau 

(43) International Publication Date 
30 May 2002 (30.05.2002) 




PCT 



(10) International Publication Number 

WO 02/42987 A2 



(51) International Patent Classification 7 : G06F 19/00 

(21) International Application Number: PCT/US0 1/46745 

(22) International Filing Date: 

8 November 2001 (08.1 1.2001) 



(25) Filing Language: 

(26) Publication Language: 



English 
English 



(30) Priority Data: 

09/721,233 22 November 2000 (22.1 1.2000) US 

(71) Applicant: CE MEDICAL SYSTEMS GLOBAL 
TECHNOLOGY COMPANY, LLC [US/US]; 3000 
North Grandview Boulevard-W-710, Waukesha, WI 53188 
(US). 

(72) Inventors: DEBBINS, Josef, Phillip; 116 West Wabash 
Avenue, Waukesha, WI 53186 (US). GOULD, Kris- 
tine, Louise; N8 W31314 Salem Court, Delafield, WI 



53018 (US). LICATO, Paul, E.; a2602 North 81st 
Street, Wauwatosa, WI 53213 (US). POLZIN, Jason, 
Andrew; 140 Franklin Street, Lake Mills, WI 53551 (US). 
THOMAS, Deepa; 118 Manchester Drive, Waukesha, WI 
53188 (US). 

(74) Agents: CHASKIN, Jay, L. et al.; General Electric Com- 
pany, 3135 Easton Turnpike W3C, Fairfield, CT 06431 
(US). 

(81) Designated States (national): CN, IN, JP, KR. 

(84) Designated States (regional): European patent (AT, BE, 
CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, IT, LU, MC, 
NL, PT, SE, TR). 

Published: 

— without international search report and to be republished 
upon receipt of that report 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



(54) Title: APPLICATION DEVELOPMENT SYSTEM FOR A MEDICAL IMAGING SYSTEM 




K 



DATA 
STORE 
SERVER 



GRADIENT 
SYSTEM 





PULSE 
SEQUENCE 
SERVER 



J 1 



PHYSIOLOGICAL 
ACQUJSmON 
CONTROLLER 




38 



DATA 
ACQUISITION 
SERVER 



h 



40 



SCAN 




PATIENT 


ROOM 




fOSmONING 


INTERFACE 




SYSTEM . 



RF 
SYSTEM 



-26 



DATA 
PROCESS 



JCESSING 
IERVER' 



< 
00 

<s 

(57) Abstract: A workstation (10) is programmed to operate as an application development system for a medical imaging system. 
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APPLICATION DEVELOPMENT SYSTEM 

FOR A MEDICAL IMAGING SYSTEM 

BACKGROUND OF THE INVENTION 

The field of the invention is medical imaging systems, and particularly, 
5 systems for developing software applications for such imaging systems. 

There are many types of medical imag J ng systems. The primary distinction 
between the different systems is the medical imaging modality that is used, 
such as, x-ray, magnetic resonance, ultrasound or nuclear. In addition, a 
broad range of capabilities and features are typically offered in each imaging 
10 modality. For example, a magnetic resonance imaging ("MRI") system may 
be offered with a range of polarizing magnetic strengths and configurations 
and with a range of different optional features such as magnetic resonance 
angiography ("MRA"), cardiac imaging and functional magnetic resonance 
imaging ("fMRI"). 

15 Despite the many differences, medical imaging systems have a number of 
basic functions in common. All medical imaging systems include an operator 
interface which enables a particular image acquisition to be prescribed, a data 
acquisition apparatus which uses one of the imaging modalities to acquire 
data from the subject, an image reconstruction processor for reconstructing 

20 an image using acquired data, and storage apparatus for storing images and 
associated patient information. Typically, hardware is designed to carry out 
these functions and system software is designed and written for each 
hardware configuration. 

A medical imaging system contains application programs which direct the 
25 imaging system to perform particular types of scans, image reconstructions 
and post processing applications. For example, an MRI system may include 
application software which directs the imaging system to perform a fast spin- 
echo scan, or a fast gradient-recalled echo scan, or a functional MRI scan, or 
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a cardiac cine scan. Each of these different applications requires the writing 
of software code in a language such as assembler, or C and the linking and 
compiling of such code for use in the MRI system. As the number of 
applications grows, the amount and complexity of the application software 
5 code becomes increasingly difficult to maintain. As a result, the addition of 
new applications to the imaging system becomes increasingly difficult. 

SUMMARY OF THE INVENTNION 

The present invention is an application development system for a medical 
imaging system, and particularly, a system for producing an object oriented 

10 application program from a library of stored components, each component 
containing methods in the form of executable code and data related to the 
operation of the medical imaging system. The application development 
system includes a memory for storing a library of components; a display 
containing a framework area providing an indication of the components stored 

15 in the library, containing a workspace area for indicating components selected 
from the library to form an application program, and containing a properties 
area for indicating instance variables of a selected component; an input \ 
device; and a processor programmed to enable a user to select with the input 
device components indicated in the framework area and place them in the 

20 workspace area, programmed to edit with the input device instance variables 
indicated in the properties area for a selected component, and programmed to 
store the components in the workspace area as an application program. 

Application programs may be created without writing and compiling program 
code. All program code is contained in the components stored in the library 

25 and the selection of components and placement in the workspace area of the 
display links the program code and any modified properties, or instance 
variables into a single application program which can be "persisted". The 
application program is stored on the medical imaging system along side the 
component library, and when the application is selected to perform a scan, the 

30 program code from the proper components in the component library are linked 
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together per the design of the stored application, and their instance variables 
set as indicated by the application program. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of an MRI system which employs the preferred 
5 embodiment of the invention; 

Fig. 2 is a block diagram of functional components in a workstation which 
forms part of the MRI system of Fig. 1 ; 

Fig. 3 is a block diagram of the software architecture of a preferred 
embodiment of an application development system which employs the 
10 present invention; 

Fig. 4 is a pictorial representation of a display produced by a visual - 
component assembler which forms part of the software architecture of Fig. 3; 

Fig. 5 is a block diagram of an imaging system which employs the present 
invention; 

15 Fig. 6 is a pictorial display of an alternative embodiment of a workspace 
region in the display of Fig. 4; 

Fig. 7 is a pictorial display of a properties portion of the display in Fig. 4 
depicting an rf pulse component; and 

Fig. 8 is a pictorial display showing a graphic plot of the rf pulse component of 
20 Fig. 7. 

GENERAL DESCRIPTION OF THE INVENTION 

Referring particularly to Fig. 5, a medical imaging system includes imaging 
apparatus 110 comprised of mechanical and electrical hardware elements 
that are operated during a scan to acquire image data. The imaging system 
25 also includes data processing apparatus 112 that is operated to reconstruct 
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images using the acquired image data. To operate the system and to enter a 
scan prescription an operator input device 114, such as a keyboard and 
control panel, is provided, a display device 116 is provided to present the 
images for visualization and a storage device 117, such as a hard disc drive, 
5 is provided to archive acquired images. The particular imaging modality used, 
and the complexity and power of these hardware elements varies 
substantially from one system to the next. 

The system includes a workstation 118 which is programmed in a machine 
independent language, such as Java™, to provide a user interface 120 that 

10 enables an operator to enter scan parameters using the operator input device 
114. The workstation 118 is programmed to produce a scan description 122, 
which in its simplest configuration contains image acquisition description 
components and data processing description components that contain - 
information required by the imaging apparatus 110 and data processing 

1 5 apparatus 1 1 2 to perform the prescribed scan. 

Prior to run time, a snap shot of the scan description 122 is downloaded to a 
plurality of servers which control the imaging system hardware apparatus. In 
the simplest configuration these include an image acquisition server 124 and 
a data processing server 126 which operate the respective imaging apparatus 
20 110 and data processing apparatus 112. When provided with the scan 
description components, the servers' programs direct the image system 
hardware apparatus to perform the prescribed scan. A data store server 1 13 
directs the storage device 117 to save the images along with associated 
patient information. 

25 The particular scan or operation that is performed by the medical imaging 
system is directed by an application program stored in the workstation 118. 

The application program is produced using an application development 
system that runs on the workstation 118 or a separate workstation (not 
shown). The application development system enables the user to create a 
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new application program by selecting objects, or components, written in an 
object-oriented programming language, from a component library, and 
assemble them using a visual component assembler. The instance variables 
of selected components are displayed and may be edited for the new 
5 application program. The assembled components are instantiated and saved 
as a new application program which may be reconstituted for use on the 
medical imaging system. Instantiation is achieved using a serialization 
process in which the hierarchical relationship of components and their 
instance variables are stored. 

10 DESCRIPTION OF THE PREFERRED EMBODIMENT 

Referring particularly to Fig. 1, the preferred embodiment of the invention is 
employed to operate an MRI system. The MRI system includes a workstation 
10 having a display 12 and a keyboard 14. The workstation 10 includes a 
processor 16 which is a programmable machine commercially available from 

15 Silicon Graphics, Inc. It is based on a 64-bit microprocessor manufactured by 
Intel and it runs the Linux operating system. The workstation 10 provides the 
operator interface which enables scan prescriptions to be entered into the 
MRI system. As will be described in more detail below, the workstation 10 will 
run one or more Java™ virtual machines which will run code which is 

20 programmed in the Java™ language that is fully transportable to any other 
programmable machine which is Java™ compatible. 

The workstation 10 is coupled to four servers: a pulse sequence server 18; a 
data acquisition server 20; a data processing server 22, and a data store 
server 23. In the preferred embodiment the data store servec231s performed 

25 by the workstation processor 16 and associated disc drive'interface circuitry. 
The remaining three servers 18, 20 and 22 are performed .by separate 
processors mounted in a single enclosure and interconnected using a 64-bit 
backplane bus structure based on the PCI standard for industrial and 
telecommunications applications called "CompactPCr. The pulse sequence 

30 server 1 8 employs a 366 MHz microprocessor model PPC750 and a quad 
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communication controller model MPC860T manufactured by Motorola, Inc. 
The data acquisition server 20 and data processing server 22 both employ the 
same 366 MHz microprocessor and the data processing server 22 further 
includes one or more array processors based on parallel vector processors 
5 commercially available from Mercury Computer Systems, Inc. as the 
PowerPC™. Another 366 MHz microprocessor (not shown) serves as a 
hardware controller on the PCI bus structure and it controls a quad 
communication controller model MPC860T manufactured by Motorola, Inc. 

The workstation- 10 and each processor for the servers 18, 20 and 22 are 
10 connected to a 100 BaseT Ethernet serial communications network. This 
serial network conveys data that is downloaded to the servers 18, 20 and 22 
from the workstation 10 and it conveys tag data that is communicated 
between the servers and between the workstation afid the servers. In 
addition, a high speed data link using the BIT3 protocol is provided between 
15 the data processing server 22 and the workstation 10 in order to convey 
image data to the data store server 23. 

The pulse sequence server 18 functions in response to program elements 
downloaded from the workstation 10 to operate a gradient system 24 and an 
RF system 26. Gradient waveforms necessary to perform the prescribed 
20 scan are produced and applied to the gradient system 24 which excites 
gradient coils In an assembly 28 to produce the magnetic field gradients G x , 
G y and G z used for position encoding NMR signals. The gradient coil 
assembly 28 forms part of a magnet assembly 30 which includes a polarizing 
magnet 32 and a whole-body RF coil 34. 

25 RF excitation waveforms are applied to the RF coil 34 by the RF system 26 to 
perform the prescribed magnetic resonance sequence. Responsive NMR 
signals detected by the RF coil 34 are received by the RF system 26, 
amplified, demodulated, filtered and digitized under direction of commands 
produced by the pulse sequence server 18. Exemplary RF systems are 

30 described in U.S. Pat. No. 4,952,877 and U.S. Pat. No. 4,992,736. 
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The pulse sequence server 18 also optionally receives patient data from a 
physiological acquisition controller 36. The controller 36 receives signals from 
a number of different sensors connected to the patient, such as ECG signals 
from electrodes or respiratory signals from a bellows. Such signals are 
5 typically used by the pulse sequence server 18 to synchronize the 
performance of the scan. 

The pulse sequence server 18 also connects to a scan room interface circuit 
38 which receives signals from various sensors associated with the condition 
of the patient and the magnet system. It is also through the scan room 
10 interface circuit 38 that a patient positioning system 40 receives commands to 
move the patient to desired positions during the scan. 

It should be apparent that the pulse sequence server 18 performs real-time 
control of MRI system elements during a scan. As a result, it is necessary 
that its hardware elements be operated with program instructions that are 

1 5 executed in a timely manner. As will be explained in more detail below, the 
pulse sequence server 18 is controlled during run-time by programs written in 
a low level programming language such as assembler, C or C++. The 
description components for a scan prescription are downloaded from the 
workstation 10 in the form of objects. The pulse sequence server 18 contains 

20 programs which receive these objects using a serialization mechanism. The 
pulse sequence server 18 also includes a program which converts the objects 
to C++ objects that are employed by the run-time programs. In the preferred 
embodiment Java™ objects are downloaded' and the Java™ serialization 
mechanism is employed. The pulse sequence server 18 thus includes both 

25 hardware independent programs written in Java™ and hardware dependent 
programs. It is contemplated that Java™ interpreters will eventually become 
fast enough that nearly all programs run on the pulse sequence server 18 will 
be written in hardware independent form. 

The digitized NMR signal samples produced by the RF system 26 are 

■ 

30 received by the data acquisition server 20. The data acquisition server 20 
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operates in response to description components downloaded from the 
workstation 10 to receive the real-time NMR data and provide buffer storage 
such that no data is lost by data overrun. In some scans the data acquisition 
server 20 does little more than pass the acquired NMR data to the data 
5 processor server 22. However, in scans which require information derived 
from acquired NMR data to control the further performance of the scan, the 
data acquisition server 20 is programmed to produce such information and 
convey it to the pulse sequence server 18. For example, during prescans 
NMR data is acquired and used to calibrate the pulse sequence performed by 

10 the pulse sequence server 18. Navigator signals may be acquired during a 
scan and used to adjust RF or gradient system operating parameters or to 
control the view order in which k-space is sampled. And, the data acquisition 
server 20 may be employed to process NMR signals used to detect the arrival 
of contrast agent in an MRA scan as described in co-pending U.S. Pat. Appln. 

1 5 Serial No. 08/635,078 filed April 1 9, 1 996 and entitled "Method For Performing 
Magnetic Resonance Angiography Using a Contrast Agent. In all these 
examples the data acquisition server 20 acquires NMR data and processes it 
in real-time to produce information which is used to control the scan. 

As with the pulse sequence server 18, the hardware elements of the data 
20 acquisition server 20 are operated at run-time with program instructions in a 
programming language such as assembler, C or C++. As will be explained in 
more detail below, the directions for its operation during a scan are 
downloaded from the workstation 10 in the form of objects. A server proxy 
receives the objects using the serialization mechanism and the downloaded 
25 objects are converted to C++ objects that are employed to operate the data 
acquisition server 20 during run-time. As indicated above, Java™ objects are 
downloaded in the preferred embodiment using the Java™ serialization 
mechanism. 

The data processing server 22 receives NMR data from the data acquisition 
30 server 20 and processes It In accordance with description components 
downloaded from the workstation 10. Such processing may include, for 
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example: Fourier transformation of raw k-space NMR data to produce two or 
three-dimensional images; the application of filters to a reconstructed image; 
the performance of a backprojection image reconstruction of acquired NMR 
data; the calculation of functional MR images; the calculation of motion or flow 
5 images, etc. 

Images reconstructed by the data processing server 22 are conveyed back to 
the workstation 10 where they are stored. Real-time images are stored in a 
data base memory cache (not shown) from which they may be output to 
operator display 12 or a display 42 which is located near the magnet 

10 assembly 30 for use by attending physicians. Batch mode images or selected 
real time images are stored in a host database on disc storage 44. When 
such images have been reconstructed and transferred to storage, the data 
processing server 22 notifies the data store server 23 on the workstation 10. - 
The workstation 10 may be used by an operator to archive the images, 

1 5 produce films, or send the images via a network to other facilities. 

Directions for the particular operations to be performed by the data processing 
server 22 are downloaded from the workstation 10. The time critical functions 
are performed with programs written in assembler, C or C++ and the 
downloaded Java™ object directions must be converted to corresponding 
20 executable code as described above. 

As indicated above, the workstation 10 is a Java™ virtual machine which 
executes programs written in the Java™ programming language. The 
workstation software is structured to perform "applications" which may be 
selected and run by an operator. Such applications correspond to clinical 
25 imaging procedures and may include, for example: 

perform a scan using an FSE pulse sequence; 

conduct a CEMRA dynamic study; 

■ 

perform an fMRI study; 
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perform image post processing 
filming 
networking 

5 An application is a collection of Java™ objects stored in an "application 
container" that may be selected by an operator to perform a scan. Referring 
particularly to Fig. 2, each application container includes a Java™ application 
controller component 46 which directs other Java™ components in the 
container to perform the scan. These other components Include a 
10 prescription controller 52 which includes a user interface component 53 and a 
prescription assistant component 55 that enable an operator to control the 
procedure performed by the application. 

The application container also includes scan descriptions 50. These scan 
descriptions are downloaded to the servers 18, 20, 22 and 23 (Fig. 1) and 
15 used by those servers to perform the prescribed scan. The stored scan 
descriptions 50 are unique for every different application. 

The preferred embodiment of the present invention is an application 
development system which produces application programs for this MRI 
system. This application program is a collection of interrelated Java™ objects 
20 within the application container Java™ object. These objects are selected and 
edited using tools in the application development system. The application 
development system may reside on the MRI system workstation 10, or it may 
reside on a separate, stand alone workstation of similar structure and 
capability. 

25 After the application program is developed, the application container object is 
serialized and stored in the disc storage 44. When the operator of the MRI 
system selects the application program, the corresponding serialized 
application container object is read from the disc memory 44 and 

. 10 
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reconstituted as shown in Fig. 2 to operate the MRI system. To better 
understand the requirements of the application development system, the 
operations perfqrmed by the MRI system under the direction of the application 
program will now be described. 

5 The application controller 46 includes an application state object 48 which 
maintains the state of the application as the scan is performed. The possible 
states during a life cycle of an application are as follows: 

Initialization 

Prescribing 
10 Prescribed 

Downloading 

Downloaded 

Prescanning 

Prescanned 
1 5 Batch Scanning 

Real Time Scanning 

Scan Paused 

Scanned 

Reconstructed 
20 Visualized. 

This life cycle is driven by commands from the application container (like 
initialize application), by commands from the operator (like start scan) and by 
commands generated internally by the application (like scan done). 

11 
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When the operator initially selects the application, the application initializes 
and changes to the "prescribing state" and the prescription controller 52 is 
enabled to interact with the scan description components 50 to determine 
what scan parameters must be specified by the operator (e.g. TR, number of 
5 slices, location of FOV.flip angle) and determine if the prescription is 
complete and valid. The prescription controller 52 then signals the application 
state object 48 to switch to the "prescribed" state and download, prescan and 
scan.buttons on the control panel are enabled. 

If the operator hits the "download" button, the application state object 48 
0 changes to the "download state" and the application controller 46 employs a 
snap shot controller 54 to issue snap shot and download commands. As will 
be described in more detail below, these commands cause the scan 
descriptions 50 to be downloaded to the servers 18, 20, 22 and 23. The snap „ 
shot controller 54 receives "download done" notification back from each of the 
5 servers 18, 20, 22 and 23, and when all four servers have been downloaded, 
the application state object 48 is changed to the "downloaded" state. 

If the operator hits the scan button, the application state object 48 will change 
to the scan mode and a scan controller 56 is employed to issue a scan 
command to the pulse sequence server 18. The next state transition is 

0 governed by the scanning mode i.e., real-time or batch. The behavior of the 
application in the two modes is very different and so there are two different 
scanning states. If in real-time mode, the application is set to a "real-time 
scanning" state and if in batch mode, the application state is set to a "batch 
scanning" state. When in the real-time mode, if the user chooses to pause 

5 the scan, the application will transition to a "scan paused" state. If scanning is 
resumed, the application goes back to the real-time scanning state. In real- 
time scanning state, the application can be edited and edited descriptions will 
be downloaded even while the scanning is in progress. However, the 
application will not make a state transition; instead, the same state will be 

0 characterized to allow editing and downloading. It is this behavior of the real- 
time scanning state that differentiates it from the batch scanning state. 

12 
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The application will make a transition to the "scanned" state when the 
operator hits the "stop scan" button. Also, if the application is in the batch 
scanning mode of operation, the pulse sequence server 18 notifies the 
application controller 46 when the scan is completed. The application state 
5 object changes to the "scanned" state in either event. 

When the data processing server 22 completes reconstruction of the acquired 
images, the application controller 46 is notified and the application state object 
48 is changed to the "reconstructed" state. This indicates to the workstation 
10 that reconstructed images are available on disk 44 for display or further 
10 processing. 

The scan descriptions 50 contain a set of components that serve to collect 
scan parameters using the prescription controller 52, and to organize those 
prescription scan parameters into a set_of smaller components that can be 
downloaded to the servers 18, 20, 22 and 23. On the servers 18, 20, 22 and 
15 23, those downloaded components direct the operation of the hardware in 
order to carry out the prescribed scan. 

There are different description types within each application to provide logical 
groupings of components to deal with different aspects of executing an MR 
scan. These description types are: 

20 Pulse Description; 

Sequence Description; 

Acquisition Description; 

Data Processing Description; 

Data Store Description. 

25 The pulse description includes components that define and control the 
waveforms to be played out on the gradient system and the RF system 
hardware, along with hardware control components. These components 

13 
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control the dynamic aspects of the waveforms and hardware in response to 
events produced at run-time by components of the sequence description. 
This description also includes components that control the filtering of NMR 
signals received by the RF system 26. These components collectively define 
5 a unique set of gradient/RF/control pulses which are used to excite, encode, 
and readout the NMR signals. Examples are pulse descriptions for 2D spin 
echo, 2D gradient-echo, 2D fast spin-echo, and 3D gradient-echo sequences. 

The sequence description includes a set of components that control the order 
of pulse sequences played out, and define a series of prescribed events along 
10 the scan timeline. These prescribed events defined by the sequence 
description trigger the dynamic behavior of the pulse components in the pulse 
description. These components prescribe a unique acquisition ordering used 
to define the slice and k-space sampling order. Examples are 2D sequential, 
2D interleaved, 3D sequential, 3D elliptical centric, and multi-slice CINE. 

15 The acquisition description includes a set of components that prescribe the 
real-time processing of NMR signals acquired by the RF system 26. These 
components direct the performance of operations on acquired NMR signals to 
produce information that is fed back to components in the sequence 
description to affect subsequent scanner operation. These components may, 

20 for example, process NMR signals during a calibration prescan to feedback 
changes in the power or frequency of RF pulses produced during the 
subsequent scan; or process NMR signals to detect when a bolus of contrast 
agent arrives in a region of interest and trigger the start of a centric view order 
acquisition; or process "navigator" NMR signals to produce phase correction 

25 information which may be used to alter the view order of the scan or alter the 
demodulation reference frequency of the RF system 26. There are scans 
commonly used in clinical applications which do not require this capability, 
however, and in those applications, the components in the acquisition 
description simply buffer or filter the acquired NMR signals and make them 

30 available to the data processing server 22. 
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The data processing description contains components that direct the data 
processing server 22 to transform acquired NMR signals into a meaningful 
form. Image reconstruction is the most common function and the resulting 
form is a 2D or 3D image of the subject being scanned. Spectroscopy 
5 processing can also be defined by these components, in which case the form 
that results is an image of the spectra of the acquired NMR signals. 

The data store description contains components that define the images which 
are stored in the database during a scan. In addition to the reconstructed 
images, this may include patient information and scan parameter information 
10 which is to appear annotated on the image along with the patient anatomic or 
spectrographs information. 

As indicated above, the application development system is implemented on a 
workstation having a memory, a display, an input device such as a keyboard 
and mouse and a processor programmed to perform the functions now to be 

15 described. Referring particularly to Figs. 3 and 4, the programs and data 
which form the software architecture of the application development system 
includes a visual component assembler 60 which produces a window display 
62 to the user that contains three areas: a framework area 64; a workspace 
area 66; and a properties area 68. The application program is developed by 

20 selecting components from the component library 72 which are displayed in 
the framework area 64 and dragging them into the workspace area 66. Such 
selected components are stored in workspace storage 67. The properties of a 
selected component in the workspace area 66 are displayed in the properties 
area 66, and these properties can be changed using an property editor 70. 

25 The components displayed in the framework area 64 are Java™ classes, or 
objects stored in a component library 72, These components are typically 
developed using a commercially available integrated development 
environment 74 such as that sold under the trademark "Forte for Java" by Sun 
Microsystems or "JBuilder" sold by Inprise. The components are written in 

30 Java™ source code and compiled into binary instructions called byte code. 
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These byte code components are saved to the appropriate packages in the 
component library 72. It can be appreciated that many Java components are 
commercially available and these can be used along with custom written Java 
components to create more complex components specifically applicable to 
5 performing the MRI functions described above. The objective is to create and 
store enough components in the component library 72 such that a user can 
build any desired application by selecting existing components. In such case, 
the user does not need to write any software code to implement new 
applications, but is simply requested to select and aggregate the desired 
10 functionality. 

Referring particularly to Figs. 3, 4 and 6, as components are dragged into the 
workspace 66 from the framework area 64, the visual component assembler 
60 establishes the hierarchical relationship between the^components. These - 
relationships are illustrated in one preferred manner in Fig. 4 by the 

15 indentation of containee component icons beneath their related container 
component icon. An alternative embodiment of the display of this hierarchical 
relationship of components in the workspace 66 is shown in Fig. 6. In this 
embodiment, arrows point from each superclass component icon to its related 
subclass component icons. It can be appreciated that the display of a 

20 complete application requires more display area than it available and that 
scroll bars may be used to display different portions of the application in the 
workspace 66. 

To build an application, the user first loads the framework area 64 with the 
library of components. The components are displayed and an application 

25 container component 76 is selected. When this component 76 is dragged to 
the workspace 66, components for all of its children are also identified. This 
initiates the building of an application, but the user must know what further 
components are required to complete the build. To assist in this effort any 
component in the workspace 66 can be selected with a right click of the 

30 mouse and a description of the function performed by that component is 
displayed in the format known as Javodoc™. 
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Each component in the workspace 66 has properties, which include numeric 
variables, Boolean variables and other class type or named variables. The 
visual component assembler enables the user to display these properties in 
the properties area 68 by left clicking on a selected component. If the user 
5 then left clicks to select one of the displayed properties in the properties area 
66, the property editor tool 70 is employed to enable the user to make the 
change. It is contemplated that most of the new applications created in 
clinical settings will be limited to changing the properties in components of 
existing applications. In other words, existing applications are dragged from 
10 the framework area 64; the properties in selected components therein are 
edited; and the result is saved back to the component library 72 as a new 
application. 

When the application is completed the selected components assembled in the - 
workspace area 66 are then persisted. This is currently accomplished by 

15 storing the application using the above described serialization mechanism, 
however, other persistence mechanisms are known and may be used. The 
persistence mechanism stores the hierarchical relationship ("graph") between 
the selected components as well as the instance variable (property) values. 
The byte code for each component in the application is not stored with the 

20 persisted application. The medical imaging system which employs the 
application must itself store the byte code for all the components used in 
applications. When the persisted application is restored, or "deserialized", on 
the MRI system, it directs the loading of the byte code indicated by the 
persisted object graph and instance variable. 

25 Because many of the components in MRI applications relate to the production 
of pulses and pulse sequences, another feature of the present invention is the 
display of waveforms or other data produced by a component. Referring 
particularly to Figs. 3, 7 and 8, all components, may include a property called 
a "visible." In the case of a pulse waveform component, when the visible 

30 property is switched to "true", a waveform plotter 78 is enabled and a pulse 
sequence plotter window 80 is produced and displayed. This window 80 
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displays the waveforms 82 and 84 which are produced by this instance of the 
component. If a property is changed using the editor 70, the displayed 
waveforms may also change. This is illustrated in Fig. 8 when the property 
"pulse type" is about to be changed. 

5 When the application is complete, the application container object is serialized 
and saved to storage. As indicated above, this serialized form of the 
application program may be restarted in another virtual Java™ machine such 
as the MRI system described above and reconstituted into an object-oriented 
application program ready for execution. 

10 One advantage of the serialized configuration of the stored application 
program is that it can efficiently be downloaded to clinical MRI systems from 
remote sites. This may be done through direct serial connection using a 
private Intranet or a public telephone system, or it may be done throbgh the 
Internet public system. In any case, the transfer of the application program is 

15 a serialized object stream which carries the class name of each object, or 
component, as well as that component's instance data which is described by 
attribute name, type, and value. Also transferred is the relationships between 
components which allows a graph of the components in the application 
program to be collected in the serial stream received at the MRI system and 

20 then recreated, or reconstituted, on the MRI system. The serialization 
mechanism follows all relationships between objects. Each object, or 
component in the graph is only serialized once. Should a component be 
referenced more than one time, the serialization process recognizes the 
repeat and inserts a reference to the previous occurrence in the graph. This 

25 prevents duplication of objects and reduces the magnitude of the download 
task. 

The serialization process also eliminates the need for downloading byte code. 
This presumes that any MRI system that receives a downloaded application 
program has a library which stores the byte code for all components 
30 contained in the application program. Updates to clinical systems may, 
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therefore, include both the downloading of new applications as well as the 
downloading of any necessary new components for the MRI system library. 

Of course, the serialization process also enables applications to be uploaded 
from clinical MRI systems. This enables applications and/or components 
5 developed at clinical research systems to be uploaded to the MRI system 
manufacturer for review and analysis. 

The application development system can also be operated in a simulation 
mode to try out the application program before an actual scan is performed on 
the MRI system hardware. This simulation capability is facilitated by the fact 

10 that the application program will run on any Java™ virtual machine with a 
suitable component library. It is also facilitated by the fact that the user 
interface is a component of the application, such that the simulation uses the 
same interface and displays the same information as when running on an MRI 
system. Simulation environment is a mode of operation of the application 

15 development system which allows a developer to test and debug his/her 
application in a near-scanner like environment. The Java application loaded 
in the component assembler collection can be first saved and then simulation 
may be started. During simulation, the servers are in "simulation mode" and 
thus certain hardware interfaces are emulated or non-functional. Typically 

20 raw data is injected into the server imaging chain to be processed as it would 
if received by the transceiver. 

During application simulation, the developer will have the opportunity to do 
certain levels of message tracing and component debug. The developer is 
provided with several levels of component message tracing, which can be set 

25 dynamically during application simulation. The developer may also invoke 
several levels of debug. During component and application development, the 
developer can set a "debug=TRUE n property in each component in order to 
access custom debug behavior for that component. Or, there may be several 
levels of debug for a property, with "0" being none or "debug off 1 . For 

30 example, the sequencing component of the sequence description may provide 

19 



WO 02/42987 PCT/USO 1/46745 

for single stepping of the slice and phase encoding looping. Any custom user 
interfaces required for a given component are provided by that component in 
debug mode. 

There may also be one or more simulation user interfaces which can be 
5 accessed during simulation to provide access to more global operations, such 
as observing the Internal behavior of a specific server, inter-server tag 
communications or perhaps observing detailed behavior of a specific server, 
including tags and agent behavior. 
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CLAIMS 

1. An application development system for a medical imaging system, 
which comprises: 

a component library (72) for storing components written in an object-oriented 
5 programming language; and 

a visual component assembler (60) for displaying in a framework area (64) 
components in the component library (72) and enabling a user to select 
components in the framework area (64) and assemble them in a workspace 
area (66), and the visual component assembler (60) being operable to persist 
10 components in the work area (66) to form an application program for the 
medical imaging system. 

2. The system as recited in claim 1 in which the visual component 
assembler (60) also displays a properties area (68) and enables a user to 
select a component in the framework area (64) and display a set of properties 

15 associated with the selected component in the properties area (68). 

3. The system as recited in claim 1 in which the persistence is performed 
by serializing components in the framework area (66). 

4. The system as recited in claim 3 in which the serializing includes 
storing a hierarchical relationship between application components and 

20 storing their properties. 

5. The system as recited in claim 2 which includes a property editor (70) 
which enables a user to change the properties displayed in the properties 
area (68). 

6. The system as recited in claim 5 in which one of the properties 
25 displayed in the properties area invokes a visual representation of the 

component, and the system includes means (78) for displaying the visual 
representation. 
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7. The system as recited in claim 6 in which the visual representation is a 
waveform and the means is a waveform plotter (78). 

8. The system as recited in claim 7 which includes a display (12) having a 
screen on which the framework area (64), the workspace area (66) and the 

5 properties area (68) are displayed. 

9. The system as recited in claim 8 in which the waveform plotter (78) 
produces a window (80) on the display (12) screen in which the waveform 
appears. 

10. The system as recited in claim 7 in which the property editor (70) is 
10 operable to change the visual representation automatically when another 

property is changed. 

11. The system as recited in claim 1 in which the object-oriented 
programming language is Java™. 

12. The system as recited in claim 3 in which the means for persisting 
1 5 employs a Java™ object serialization mechanism. 

13. A system for producing an application program for a magnetic 
resonance imaging system, which comprises: 

a memory for storing a library (72) comprising components written in an 
object-oriented programming language; 

20 a workstation (10) having a display (12), an input device (14) and a processor 
(16) programmed to perform application development functions, the 
application development program including: 

a visual component assembler (60) for displaying in a framework area (64) on 
the display (12) icons representing components in the component library (72) 
25 and responsive to directions from a user entered through the input device (14) 
to select components and assemble icons representative of the selected 
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components in a workspace area (66) displayed on the display; and for 
persisting the selected components to form an application program. 

14. The system as recited in claim 13 in which the persistence is 
performed using a serialization mechanism which stores the application 

5 program. 

15. The system as recited in claim 13 in which the visual component 
assembler (60) also displays a properties area (68) on the display (12) and it 
enables a user to select a component and display properties associated with 
the selected component in the properties area (68). 

10 16. The system as recited in claim 15 in which the application development 
program also includes a property editor (70) which enables a user to input 
data through the input device (14) to change property values displayed in the 
properties area (68). 

17. The system as recited in claim 16 in which one of the properties 
15 displayed in the properties area is a visual representation of the component 

and the application development program also includes a waveform plotter 
(78) for displaying the visual representation. 

18. The system as recited in claim 17 in which the waveform plotter (78) 
produces a window (80) on the display (12) in which the visual representation 

20 is produced. 

19. The system as recited in claim 17 in which the property editor (70) is 
operable to change the visual representation automatically when another 
property is changed. 
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